Single and Multi-Agent Deep Reinforcement Learning for AI-Enabled Wireless Networks: A Tutorial

نویسندگان

چکیده

Deep Reinforcement Learning (DRL) has recently witnessed significant advances that have led to multiple successes in solving sequential decision-making problems various domains, particularly wireless communications. The next generation of networks is expected provide scalable, low-latency, ultra-reliable services empowered by the application data-driven Artificial Intelligence (AI). key enabling technologies future networks, such as intelligent meta-surfaces, aerial and AI at edge, involve more than one agent which motivates importance multi-agent learning techniques. Furthermore, cooperation central establishing self-organizing, self-sustaining, decentralized networks. In this context, tutorial focuses on role DRL with an emphasis deep Multi-Agent (MARL) for AI-enabled first part paper will present a clear overview mathematical frameworks single-agent RL MARL. main idea work motivate beyond model-free perspective was extensively adopted recent years. Thus, we selective description algorithms Model-Based (MBRL) cooperative MARL highlight their potential applications Finally, state-of-the-art fields Mobile Edge Computing (MEC), Unmanned Aerial Vehicles (UAV) cell-free massive MIMO, identify promising research directions. We expect stimulate endeavors build scalable systems based

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Multi-Agent Deep Reinforcement Learning

This work introduces a novel approach for solving reinforcement learning problems in multi-agent settings. We propose a state reformulation of multi-agent problems in R that allows the system state to be represented in an image-like fashion. We then apply deep reinforcement learning techniques with a convolution neural network as the Q-value function approximator to learn distributed multi-agen...

متن کامل

Lenient Multi-Agent Deep Reinforcement Learning

Much of the success of single agent deep reinforcement learning (DRL) in recent years can be attributed to the use of experience replay memories (ERM), which allow Deep Q-Networks (DQNs) to be trained efficiently through sampling stored state transitions. However, care is required when using ERMs for multi-agent deep reinforcement learning (MA-DRL), as stored transitions can become outdated bec...

متن کامل

Deep Reinforcement Learning for Event-Driven Multi-Agent Decision Processes

The incorporation of macro-actions (temporally extended actions) into multi-agent decision problems has the potential to address the curse of dimensionality associated with such decision problems. Since macro-actions last for stochastic durations, multiple agents executing decentralized policies in cooperative environments must act asynchronously. We present an algorithm that modifies Generaliz...

متن کامل

Stabilising Experience Replay for Deep Multi-Agent Reinforcement Learning

Many real-world problems, such as network packet routing and urban traffic control, are naturally modeled as multi-agent reinforcement learning (RL) problems. However, existing multi-agent RL methods typically scale poorly in the problem size. Therefore, a key challenge is to translate the success of deep learning on singleagent RL to the multi-agent setting. A key stumbling block is that indep...

متن کامل

Learning to Communicate with Deep Multi-Agent Reinforcement Learning

We consider the problem of multiple agents sensing and acting in environments with the goal of maximising their shared utility. In these environments, agents must learn communication protocols in order to share information that is needed to solve the tasks. By embracing deep neural networks, we are able to demonstrate endto-end learning of protocols in complex environments inspired by communica...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Communications Surveys and Tutorials

سال: 2021

ISSN: ['2373-745X', '1553-877X']

DOI: https://doi.org/10.1109/comst.2021.3063822